Skip to content

Attempt to fix flaky burn rate test#212039

Merged
maryam-saeidi merged 2 commits intoelastic:mainfrom
maryam-saeidi:fix-flaky-reason-message
Feb 25, 2025
Merged

Attempt to fix flaky burn rate test#212039
maryam-saeidi merged 2 commits intoelastic:mainfrom
maryam-saeidi:fix-flaky-reason-message

Conversation

@maryam-saeidi
Copy link
Copy Markdown
Member

@maryam-saeidi maryam-saeidi commented Feb 21, 2025

Fixes #211439

Summary

@simianhacker pointed out that the alignEventsToInterval setting aligns the data generation so that we have the exact number of documents in each bucket; I noticed this setting is missing for the burn rate rule test.

How to run the test

// Server
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts

// Test
node scripts/functional_test_runner --config=x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="Burn rate rule"

@maryam-saeidi maryam-saeidi added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting labels Feb 21, 2025
@maryam-saeidi maryam-saeidi self-assigned this Feb 21, 2025
@maryam-saeidi maryam-saeidi requested a review from a team as a code owner February 21, 2025 10:57
@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

cc @maryam-saeidi

@dominiqueclarke
Copy link
Copy Markdown
Contributor

@maryam-saeidi Did you run this against flaky test runner?

@maryam-saeidi
Copy link
Copy Markdown
Member Author

maryam-saeidi commented Feb 25, 2025

@maryam-saeidi Did you run this against flaky test runner?

No, I didn't think it was necessary, as the issue only happened a few times. Recently, I fixed some minor issues for the tests that failed very few times, so I didn't run the flaky test runner for them. Let me know if you think it would be useful to run it.

Copy link
Copy Markdown
Contributor

@dominiqueclarke dominiqueclarke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@maryam-saeidi maryam-saeidi merged commit cb6e0be into elastic:main Feb 25, 2025
@maryam-saeidi maryam-saeidi deleted the fix-flaky-reason-message branch February 25, 2025 20:36
JoseLuisGJ pushed a commit to JoseLuisGJ/kibana that referenced this pull request Feb 27, 2025
Fixes elastic#211439

## Summary

@simianhacker pointed out that the `alignEventsToInterval` setting
aligns the data generation so that we have the exact number of documents
in each bucket; I noticed this setting is missing for the burn rate rule
test.

### How to run the test

```
// Server
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts

// Test
node scripts/functional_test_runner --config=x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="Burn rate rule"
```

Co-authored-by: Dominique Clarke <dominique.clarke@elastic.co>
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Mar 22, 2025
Fixes elastic#211439

## Summary

@simianhacker pointed out that the `alignEventsToInterval` setting
aligns the data generation so that we have the exact number of documents
in each bucket; I noticed this setting is missing for the burn rate rule
test.

### How to run the test

```
// Server
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts

// Test
node scripts/functional_test_runner --config=x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="Burn rate rule"
```

Co-authored-by: Dominique Clarke <dominique.clarke@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes v9.1.0

Projects

None yet

4 participants